NATO STO

Augmented Reality (AR) is a feasible technology to improve Situational Awareness as has been considered during the exploratory work in the ET AVT-HFM 216 –“Human Systems Integration of Augmented Reality for Land Platforms in combat environments” (January 2022 to 31 December 2022). AVT-HFM 216 and the work currently being done in the RTG HFM-330 – “Human Systems Integration for Meaningful Human Control over AI-based systems” have highlighted the need for a deeper understanding of the Human Factors (HF), Human Systems Integration (HSI) and Controllability aspects if the full potential of Augmented Reality solutions for Land Platforms is to be realised. AVT-HFM 216 developed topics and vignettes to define the operational driven requirements for using AR in various Land Forces scenarios, examples include combat medical support, equipment support and repair tasks, subterranean operations and a mounted-to-dismounted transition scenario. The work highlighted several HF, medical and technological challenges that need to be addressed including remote operation, triage, local and global situation awareness, clutter, workload, uncertainty, user controls, etc. in addition, since AR can support decision making, including engagement decisions, meaningful human control and trust of displayed AR become important issues. The aim of this RTG is to follow on the relevant Human Systems Integration dimensions of Augmented Reality for Land Platforms in combat environments determined in ET AVT-HFM 216 and to also exploit the drafted scenarios to propose detailed vignettes and AR solutions as well as conducting respective evaluations. The scope of work shall include human factors of display devices and controls, perception of symbols with respect to the real world, clutter, impact of workload, displaying uncertainties (as related to timeliness, completeness, and accuracy of information) and issues of Human Systems Integration.